Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

During sleep and awake rest, the hippocampus replays sequences of place cells that have been activated during prior experiences. These have been interpreted as a memory consolidation process, but recent results suggest a possible interpretation in terms of reinforcement learning. The Dyna reinforcement learning algorithms use off-line replays to improve learning. Under limited replay budget, a prioritized sweeping approach, which requires a model of the transitions to the predecessors, can be used to improve performance. We investigate whether such algorithms can explain the experimentally observed replays. We propose a neural network version of prioritized sweeping Q-learning, for which we developed a growing multiple expert algorithm, able to cope with multiple predecessors. The resulting architecture is able to improve the learning of simulated agents confronted to a navigation task. We predict that, in animals, learning the world model should occur during rest periods, and that the corresponding replays should be shuffled.Comment: Living Machines 2018 (Paris, France

Layer by layer - Combining Monads

We develop a method to incrementally construct programming languages. Our approach is categorical: each layer of the language is described as a monad. Our method either (i) concretely builds a distributive law between two monads, i.e. layers of the language, which then provides a monad structure to the composition of layers, or (ii) identifies precisely the algebraic obstacles to the existence of a distributive law and gives a best approximant language. The running example will involve three layers: a basic imperative language enriched first by adding non-determinism and then probabilistic choice. The first extension works seamlessly, but the second encounters an obstacle, which results in a best approximant language structurally very similar to the probabilistic network specification language ProbNetKAT

Mines and bats: the impact of open-pit mining on bat activity

This is the author accepted manuscript. The final version is available from the publisher via the DOI in this recordAreas used in open-pit mining often undergo sudden and extensive landscape changes, including habitat fragmentation. With mining activity predicted to expand, understanding the impacts of this habitat loss on wildlife is key to developing effective mitigation at new mine developments. Despite this, research into the impacts of open-pit mines in general, and on bat populations in particular, is largely lacking. Here, we investigated potential impacts of a recently re-established open-pit mine in southwest Britain on bat activity in the surrounding landscape, using remote monitoring techniques. Distance from the mine site boundary was found to be an important predictor of bat species richness and activity levels, with the effect on richness extending to approximately 900 m from the site and the effect on activity potentially extending beyond the sampling range (1,200 m). The effect of distance from the site boundary on species richness also varied with the proportion of woodland cover. It appears that habitat loss within the mine site boundary may have reduced bat movement because of barrier effects. The study highlights the need for further research into the impacts of mines on bats.Wolf Mineral

Effects of Supersymmetric Threshold Corrections on High-Scale Flavor Textures

Integration of superpartners out of the spectrum induces potentially large contributions to Yukawa couplings. These corrections, the supersymmetric threshold corrections, therefore influence the CKM matrix prediction in a non-trivial way. We study effects of threshold corrections on high-scale flavor structures specified at the gauge coupling unification scale in supersymmetry. In our analysis, we first consider high-scale Yukawa textures which qualify phenomenologically viable at tree level, and find that they get completely disqualified after incorporating the threshold corrections. Next, we consider Yukawa couplings, such as those with five texture zeroes, which are incapable of explaining flavor-changing proceses. Incorporation of threshold corrections, however, makes them phenomenologically viable textures. Therefore, supersymmetric threshold corrections are found to leave observable impact on Yukawa couplings of quarks, and any confrontation of high-scale textures with experiments at the weak scale must take into account such corrections.Comment: 25 pages, submitted to JHE

Teachers’ appraisals of adjectives relating to mathematics tasks

Curricular implementations are unlikely to deliver the anticipated benefits for mathematics learners if written guidance to teachers is interpreted and enacted differently from the ways that policymakers and curriculum designers intend. One way in which this could happen is in relation to the mathematics tasks that teachers deploy in the classroom. Teachers and curriculum designers have developed an extensive vocabulary for describing tasks, using adjectives such as ‘rich’, ‘open’, ‘real-life’, ‘engaging’ and so on. But do teachers have a shared understanding of what these adjectives mean when they are applied to mathematics tasks? In Study 1 we investigated teachers’ appraisals of adjectives used to describe mathematics tasks, finding that task appraisals vary on seven dimensions, which we termed engagement, demand, routineness, strangeness, inquiry, context and interactivity. In Study 2, focusing on the five most prominent dimensions, we investigated whether teachers have a shared understanding of the meaning of adjectives when applied to mathematics tasks. We found that there was some agreement about inquiry and context, some disagreement about routineness, and clear disagreement about engagement and demand. We conclude that at least some adjectives commonly used to describe tasks are interpreted very differently by different teachers. Implications for how tasks might be discussed meaningfully by teachers, teacher educators and curriculum designers are highlighted

Balancing the dilution and oddity effects: Decisions depend on body size

Background Grouping behaviour, common across the animal kingdom, is known to reduce an individual's risk of predation; particularly through dilution of individual risk and predator confusion (predator inability to single out an individual for attack). Theory predicts greater risk of predation to individuals more conspicuous to predators by difference in appearance from the group (the ‘oddity’ effect). Thus, animals should choose group mates close in appearance to themselves (eg. similar size), whilst also choosing a large group. Methodology and Principal Findings We used the Trinidadian guppy (Poecilia reticulata), a well known model species of group-living freshwater fish, in a series of binary choice trials investigating the outcome of conflict between preferences for large and phenotypically matched groups along a predation risk gradient. We found body-size dependent differences in the resultant social decisions. Large fish preferred shoaling with size-matched individuals, while small fish demonstrated no preference. There was a trend towards reduced preferences for the matched shoal under increased predation risk. Small fish were more active than large fish, moving between shoals more frequently. Activity levels increased as predation risk decreased. We found no effect of unmatched shoal size on preferences or activity. Conclusions and Significance Our results suggest that predation risk and individual body size act together to influence shoaling decisions. Oddity was more important for large than small fish, reducing in importance at higher predation risks. Dilution was potentially of limited importance at these shoal sizes. Activity levels may relate to how much sampling of each shoal was needed by the test fish during decision making. Predation pressure may select for better decision makers to survive to larger size, or that older, larger fish have learned to make shoaling decisions more efficiently, and this, combined with their size relative to shoal-mates, and attractiveness as prey items influences shoaling decisions

Interphase chromosome positioning in in vitro porcine cells and ex vivo porcine tissues

Copyright @ 2012 The Authors. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and 85 reproduction in any medium, provided the original author and source are credited. The article was made available through the Brunel University Open Access Publishing Fund.BACKGROUND: In interphase nuclei of a wide range of species chromosomes are organised into their own specific locations termed territories. These chromosome territories are non-randomly positioned in nuclei which is believed to be related to a spatial aspect of regulatory control over gene expression. In this study we have adopted the pig as a model in which to study interphase chromosome positioning and follows on from other studies from our group of using pig cells and tissues to study interphase genome re-positioning during differentiation. The pig is an important model organism both economically and as a closely related species to study human disease models. This is why great efforts have been made to accomplish the full genome sequence in the last decade. RESULTS: This study has positioned most of the porcine chromosomes in in vitro cultured adult and embryonic fibroblasts, early passage stromal derived mesenchymal stem cells and lymphocytes. The study is further expanded to position four chromosomes in ex vivo tissue derived from pig kidney, lung and brain. CONCLUSIONS: It was concluded that porcine chromosomes are also non-randomly positioned within interphase nuclei with few major differences in chromosome position in interphase nuclei between different cell and tissue types. There were also no differences between preferred nuclear location of chromosomes in in vitro cultured cells as compared to cells in tissue sections. Using a number of analyses to ascertain by what criteria porcine chromosomes were positioned in interphase nuclei; we found a correlation with DNA content.This study is partly supported by Sygen International PLC

Mid-infrared optical parametric amplifier using silicon nanophotonic waveguides

All-optical signal processing is envisioned as an approach to dramatically decrease power consumption and speed up performance of next-generation optical telecommunications networks. Nonlinear optical effects, such as four-wave mixing (FWM) and parametric gain, have long been explored to realize all-optical functions in glass fibers. An alternative approach is to employ nanoscale engineering of silicon waveguides to enhance the optical nonlinearities by up to five orders of magnitude, enabling integrated chip-scale all-optical signal processing. Previously, strong two-photon absorption (TPA) of the telecom-band pump has been a fundamental and unavoidable obstacle, limiting parametric gain to values on the order of a few dB. Here we demonstrate a silicon nanophotonic optical parametric amplifier exhibiting gain as large as 25.4 dB, by operating the pump in the mid-IR near one-half the band-gap energy (E~0.55eV, lambda~2200nm), at which parasitic TPA-related absorption vanishes. This gain is high enough to compensate all insertion losses, resulting in 13 dB net off-chip amplification. Furthermore, dispersion engineering dramatically increases the gain bandwidth to more than 220 nm, all realized using an ultra-compact 4 mm silicon chip. Beyond its significant relevance to all-optical signal processing, the broadband parametric gain also facilitates the simultaneous generation of multiple on-chip mid-IR sources through cascaded FWM, covering a 500 nm spectral range. Together, these results provide a foundation for the construction of silicon-based room-temperature mid-IR light sources including tunable chip-scale parametric oscillators, optical frequency combs, and supercontinuum generators

Cross-polarized photon-pair generation and bi-chromatically pumped optical parametric oscillation on a chip

Nonlinear optical processes are one of the most important tools in modern optics with a broad spectrum of applications in, for example, frequency conversion, spectroscopy, signal processing and quantum optics. For practical and ultimately widespread implementation, on-chip devices compatible with electronic integrated circuit technology offer great advantages in terms of low cost, small footprint, high performance and low energy consumption. While many on-chip key components have been realized, to date polarization has not been fully exploited as a degree of freedom for integrated nonlinear devices. In particular, frequency conversion based on orthogonally polarized beams has not yet been demonstrated on chip. Here we show frequency mixing between orthogonal polarization modes in a compact integrated microring resonator and demonstrate a bi-chromatically pumped optical parametric oscillator. Operating the device above and below threshold, we directly generate orthogonally polarized beams, as well as photon pairs, respectively, that can find applications, for example, in optical communication and quantum optics

Effect of correlations on network controllability

A dynamical system is controllable if by imposing appropriate external signals on a subset of its nodes, it can be driven from any initial state to any desired state in finite time. Here we study the impact of various network characteristics on the minimal number of driver nodes required to control a network. We find that clustering and modularity have no discernible impact, but the symmetries of the underlying matching problem can produce linear, quadratic or no dependence on degree correlation coefficients, depending on the nature of the underlying correlations. The results are supported by numerical simulations and help narrow the observed gap between the predicted and the observed number of driver nodes in real networks